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[57] ABSTRACT 

A computer system includes a local non-volatile data storage 
medium and a visual display device. A still image is stored 
as a compressed data file in a multi-resolution compression 
format on the non-volatile data storage medium. The multi- 
resolution format is of a type that allows efficient progres- 
sive decompression and display of the selected still image. 
The computer system includes a data processor programmed 
to decompress the compressed data file, to produce succes- 
sive versions of (he selected still image at progressively 
increasing resolutions, and to display the successive ver- 
sions on me visual display device. The computer system has 
a data retrieval medium through which the data processor 
retrieves the compressed data file from the local non-volatile 
data storage medium. The data retrieval medium has a data 
transfer rate that is at least as fast as the data processor can 
decompress the compressed data file and display the suc- 
cessive versions of the selected still image. 

26 Claims, 5 Drawing Sheets 
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1 

COMMON DIGITAL REPRESENTATION OF 
STILL IMAGES FOR DATA TRANSFER 
WITH BOTH SLOW AND FAST DATA 
TRANSFER RATES 

TECHNICAL FIELD 

This invention relates to systems and methods for dis- 
playing large, digitally-represented still images originating 
from local sources such as CD-ROMs, floppy disks, and 
hard disk drives. 

BACKGROUND OF THE INVENTION 

A great variety of resources are currently available to 
computer users. Digitally-represented stflJ images are an 
example of one popular resource. In the computer 
environment, still images are used for a variety of purposes. 
For instance, computer-generated images or graphics are 
used in conjunction with educational software. Digitally- 
stored photographs or other images are also used for enter- 
tainment purposes in many computer applications such as 
games. Still images are increasingly being used for adver- 
tising purposes in conjunction with the Internet or commer- 
cial on-line services. In addition, many images are available 
as independent data files on the Internet and the commercial 
on-line services, 

A typical still image for computer viewing might be 
represented by a matrix of pixel values having dimensions of 
1024x1000 ox greater. Each pixel might be represented by 
up to 24 bits. Thus, a typical image might require 3 Mbytes 
of data storage. This is a relatively large storage requirement 
that creates potential difficulties in distributing images to 
ultimate viewers. 

Images are typically distributed using either a remotely- 
accessed on-line source or a physical distribution media 
such as a floppy disk, CD-ROM (compact disk read-only 
memory), or other type of non-volatile storage medium. 
When distributing an image via an on-line source, large 
storage requirements result in very large image transmission 
times. For instance, transmitting a 1024x1000x24 bit image 
might take over forty minutes using a common modem 
speed of 9600 baud. Forty minutes exceeds the tolerance of 
all but the most determined of users. 

When distributing images via physical distribution media 
such as CD-ROMs, large image storage requirements can 
impose significant limitations on the number of images that 
can be stored on a single medium. For instance, the capacity 
of a CD-ROM is currently about 600 Mbytes, sufficient for 
only about 200 1024x1000x24 still images. 

Fortunately, still images can be efficiently compressed 
using a variety of well known techniques. With such 
techniques, an uncompressed 3 Mbyte image might be 
compressed by a factor of 10 or more, to under 300 Kbytes. 
Transmitting a 1024x1000x24 image in compressed format 
would take less than five minutes, and perhaps 2000 of such 
images could be stored on a CD-ROM. 

Even with compression, however, transmission times 
from on-line services can be so great as to frustrate even the 
most patient consumers of still images. Five minutes, for 
example, is like an eternity to a computer user who is 
accustomed to split-second responses. A user's frustration is 
often increased by the fact that the receiving computer 
appears to be doing nothing during the entire time the image 
is being transmitted. Furthermore, a user may find, after 
investing significant time to download an image, that the 
image is not what he or she was looking for. 
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To improve user satisfaction, progressive image transmis- 
sion and display has been used for transferring still images 
over relatively slow communications media such as modem- 
based communications channels. In progressive image trans- 

5 mission and display schemes, information is transferred in 
such a way that a receiving computer can initially and 
quickly reconstruct a low-quality or relatively low- 
resolution version of the ultimate image for die immediate 
gratification of the user. As more information is transmitted, 
the receiving computer can display an image at progres- 

10 sively increasing quality or resolution until the final image 
is displayed. At any time during the transmission, the user 
can decide that the image is not worth the wait and can abort 
the transfer. 

Progressive image transmission schemes have been found 

15 to greatly improve user satisfaction since they give the 
viewer some idea of the image quickly, while waiting for the 
full resolution version of the image to be displayed. One 
particularly efficient form of image storage and progressive 
image transmission is described in a U.S. Patent Application 

20 entitled "Progressive Image Transmission Using Discrete 
Wavelet Transforms," by inventor Philippe Ferriere (filed 
Dec. 5, 1994. Ser. No. 08/349324). which is hereby incor- 
porated by reference. 
In the past the time to display an image from a CD-ROM 

25 or a hard disk has been minimal. However, new. higher 
resolution computer display systems are causing an increase 
in the size and complexity of images. Thus, the wait while 
an image is decompressed and displayed has in many cases 
become an irritation even though data retrieval rates with 

30 CD-ROMs and hard disks are relatively fast To remedy this, 
efforts have been made to increase the speed of decompres- 
sion and display utilities. To date, progressive image trans- 
mission and display has been used only in situations where 
data transfer is relatively slow. This is not the case, however, 
with CD-ROMs and hard disks. Accordingly, it has been 

35 believed that the extra decompression steps required in 
progressive transmission and display schemes arc not prac- 
tical in these environments, where data transfer rates are so 
great that they are not a limiting factor. In these 
environments, other compression schemes are used that do 

40 not provide for progressive transfer and display of images. 
It is typical to produce and maintain two or more versions of 
a still image, one for on-line distribution and the other for 
distribution via physical media. 

SUMMARY OF THE INVENTION 

45 The preferred ernbodiment of the invention uses progres- 
sive display technology even in environments where the 
speed of image retrieval is not a limiting factor. This is the 
case, for instance, with CD-ROMs and hard disks. In such 
environments the use of progressive image display has not 

50 previously been considered because of the extra steps 
involved. In fact, it may be that the time to display a 
complete image, at full resolution, will be greater using 
progressive display techniques than with current non- 
progressive compression schemes. This fact has apparently 

35 lead software designers away from the use of progressive 
image display when image retrieval speed is relatively fast 
User satisfaction, however, will increase even in these 
environments because of the more immediate gratification 
available to the user. Also, there is a significant advantage to 

60 producers of multi-media software in being able to use the 
same storage format for images whether they are to be 
distributed via physical distribution media or via on-line 
services. 

BRIEF DESCRIPTION OF THE DRAWINGS 

65 

FIG. 1 shows a computer system in accordance with a 
preferred embc»diment of the invention. 
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FIG. 2 is a data flow diagram in accordance with the decompression component 34 at a data transfer rate which is 

invention. at least as fast as a decompression rate at which decompress 

FIGS. 3-5 are flow charts showing preferred method- skm component 34 can decompress the confessed data file. 

. . . ct „ „ f ;„v,- nt i on Because of this, the speed at which an image can be 

ological steps of the invention. ^ retrieved, decornrresse/and displayed is not significantly 

DETAILED DESCRIPTION OF THE limited by data transfer rates. Rather, the speed of preparing 

PREFERRED EMBODIMENT an for display is limited primarily by the speed of data 

decompression. Other types of physical storage devices 

FIG. 1 shows a computer system and on-line service in might of course be substituted for those shown, provided 

accordance with a preferred embodiment of the invention. that they provide relatively fast data transfer rates which do 

The system includes a computer 10 having a data processor not limit the rate at which a compressed data file can be 

12 and a visual display device 14. The computer is prefer- prepared for viewing. 

ably any one of a number of widely available personal or environment, which utilizes relatively fast data 

desktop computers. The terra "data processor" as used retrieval rates, is precisely the environment in which pre- 

herein is not intended to be limited to a single central gressive display has not been used in the past It has been 

processing unit (CPU). Rather, the functions described found however, that significant benefits can be attained by 

below can advantageously be performed by computers hav- using progressive decompression and/or display even in 

ing two or more CPUs executing in parallel Visual display conjunction with relatively fast data sources such as 

device 14 is of a type which displays a matrix of pixels of CD-ROMs and hard disks. For instance, it has become 

variable color and intensity to represent one or more images. ^ common to limit the size or resolution of images so that they 

Computer 10 includes local, non-volatile, physical stor- can be displayed more quickly. With the invention, however, 

age media. Specifically, computer 10 includes a floppy disk this is not necessary. The image can be initially displayed at 

16 and associated floppy drive unit 18. a hard disk 20. and a low resolution (which can correspond to a small size) and 

a CD-ROM 22 and associated CD-ROM drive unit 24. In then refined to a higher resolution (and larger size) subject 

accordance with the invention, selected still images are 2J to the patience of the user. 

stored as compressed data files on one or more of the large The invention is not limited to the progressive retrieval of 

physical storage media. These compressed data files are information from fast data sources. Rather, the data file can 

preferably stored in a multi-resolution compression format be retrieved in its entirety before decompression begins, 

which allows efficient progressive decompression and dis- s ucn a scenario is illustrated in FIG. 3. which shows an 

play of still images* This means that the files can be ^ initial step 100 of retrieving a compressed data file from a 

progressively decompressed in a manner that provides a ioaii. non-volatile storage medium. At block 102, data 

number of successive versions of a still image, each at a processor 12 decompresses whatever portion of the data file 

progressively higher resolution. Ideally, a specific resolution i s ncccssar y to produce a version of the still image having a 

can be obtained with only a fraction of the work required to higher resolution than the last version produced. Block 104 

eventually obtain the highest available resolution, and with 35 shows displaying the still image version resulting from 

no more work than would be required if the specific reso- block 102. As indicated by decision block 106, these steps 

lution were the highest available resolution from the data m rc pcatcd until the highest-resolution version of the still 

file. image has been decompressed and displayed, subject of 

Data processor 12 is programmed, upon the request of a course to termination of the process by a user. Note that steps 

user or an application program executing on computer 10. to ^ 102 and 104 (corresponding to operation of the decompres- 

retrieve the compressed data file representing an image; to sion and display components above, respectively) are per- 

progressively decompress the compressed data file.produc- formed only after the retrieving step is completed, 

ing successive versions of the selected still image at pro- fig. 4 shows an alternate method of retrieving, 

gressively increasing resolutions; and to progressively dis- decompressing, and displaying a still image, in which 

play the successive versions on visual display device 14. 45 retrieval is again performed first, while decompression and 

FIG. 2 shows the data flow described above. In the display are performed progressively only after the entire 

example shown in FIG. 2. the compressed data file is image file has been retrieved. In this case, the image display 

initially stored on CD-ROM 22. A data retrieval component component acts concurrently with the decompression com- 

30. implemented by data processor 12, retrieves the data file ponent to display versions of the selected still image while 

from the CD-ROM and buffers the retrieved data to RAM 50 subsequent versions of the image are still being decom- 

(random access memory) 32. A decompression component pressed by the decompression component Step 110 shows 

34, also implemented by data processor 12. takes the data retrieving an entire image data file into RAM buffers. In step 

from RAM and decompresses it to produce successive 112, two concurrent or parallel threads or processes are 

versions of the still image represented by the data file at initiated for decompression and display, respectively, 

progressively increasing resolutions. These versions are 55 Decompression is performed in a first execution thread, 

buffered to RAM 32. An image display component 36. again shown as Thread L consisting of a decompression step 114. 

implemented by data processor 12 in conjunction with video The method of decompression is such that data is made 

display hardware, is operably connected to display the available for display on a progressive basis, so that increas- 

successive versions of the still image produced by the ingly higher resolutions of the still image can be displayed, 

decompression component od visual display device 14. 60 Although it is not a requirement, it is preferable that the 

Floppy drive unit 18. hard disk 20. and CD-ROM drive data file be formatted using a multi-resolution compression 

unit 24 are accessed through conventional local bus inter- scheme to facilitate progressive decompression. Even more 

faces or interface cards. Such interfaces or cards provide preferably, the still image is compressed and stored on the 

data retrieval media through which data processor 12 non-volatile storage medium using a discrete wavelet trans* 

retrieves data or files from the physical storage media. These 65 form such as disclosed in the patent application identified 

devices are operably connected to supply the compressed above by Ferriere. Using a multi-resolution format is a 

data file from the non-volatile data storage medium to significant advantage when producing software products 
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that include digitally-represented still images because the 
same format can be used for both on-line distribution of 
images as well as for distribution via physical media such as 
CD-ROMs or floppy disks. 

Progressive display is implemented in a second execution 
thread shown as Thread IL comprising steps 116, 11$, and 
120. Step 116 comprises waiting for that data from step 114 
which represents the next version of the still image. Step 118 
comprises displaying the next version on the visual display 
device. Decision block 120 indicates that steps 116 and 118 
are repeated until the highest resolution is reached. 

It is also possible to perform retrieval, decompression, 
and display steps concurrently or simultaneously, as shown 
in FIG. 5. In this case, the process begins at block 130 by 
initiating three parallel or concurrent execution threads or 
processes. A first thread, referred to in FIG. 4 as Thread I. 
comprises a step 132 of retrieving a compressed data file into 
a RAM buffer. A second thread. Thread II, comprises steps 
134, 136, and 138 of decompressing the data file to produce 
successive versions of the still image at progressively 
increasing resolutions. Step 134 comprises waiting on 
Thread I for enough data to be retrieved to decompress the 
first (or next) version of the still image represented by the 
data file. For this scheme to be practical, the data file should 
be compressed in an appropriate multi-resolution compres- 
sion format which allows progressive retrieval of the image. 
Step 136 comprises decompressing the next resolution of the 
still image after the data for the version becomes available 
from Thread L As indicated by decision block 138, steps 134 
and 136 arc repeated as long as any further versions of the 
still image remain to be decompressed. 

A Thread m comprises steps 140, 142, and 144 of 
displaying the successive versions of the still image as they 
become available from Thread C. Step 140 comprises wait 
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an image viewing program executing on a computer can use 
a common progressive o^compression and display scheme 
to display a retrieved still image regardless of the source of 
the image. 

In compliance with the statute, the invention has been 
described in language more or less specific as to structural 
and methodical features. It is to be understood, however, that 
the invention is not limited to the specific features described, 
since the means herein disclosed comprise preferred forms 
of putting the invention into effect The invention is, 
therefore, claimed in any of its forms or modifications within 
the proper scope of the appended claims appropriately 
interpreted in accordance with the doctrine of equivalents. 

What is claimed is: 

1. A still image display system for displaying a still image 
stored as a compressed data file, comprising: 

a progressive decompression component which decom- 
presses the compressed data file and produces succes- 
sive versions of the still image at progressively increas- 
ing resolutions; 
a data retrieval medium operably connected to supply the 
compressed data file to the oecompression component 
at a rate which is at least as fast as the decompression 
component can decompress the compressed data file; 
a visual display device; 

an image display component operably connected to suc- 
cessively display the successive versions of the still 
image produced by the deconmression component on 
the visual display device; 
wherein the decompression component acts concurrently 
with the data retrieval medium to decompress the 
compressed data file concurrently with retrieving the 
compressed data file. 

2. A still image display system as recited in claim 1 



become available from Thread C. Step 140 comprises wait- 33 whacin 4e decompression component acts subsequent to 
ing on Thread U for the next version of the still image to be ^ ^ rctrieval medium to decompress the compressed 
decompressed. Step 142 comprises actually displaying or ^ file after retrieving the compressed data file, 
updating the display of the still image with the newest 3 a still image display system as recited in claim 1 
version from Thread IL As shown by decision block 1M. wnc rein the image display component acts concurrenUy with 
steps 140 and 124 are repeated as Jong asjany further ^ the decompression component to display versions of the still 

image while subsequent versions of the selected still image 
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steps i«w ana aic icp&aiw — — j - — 

versions of the still image remain to be decompressed. 

The invention further includes a production method for 
preparation and storage of digitally-represented still images 
for subsequent distribution via different types of distribution 
media. Such distribution media might include slow media 
having relatively slow data transfer rates that significantly 
limit the speed at which an image can be displayed for 
viewing, such as remotely-accessed on-line services 
accessed by telephone modem. Such distribution media 
might also include fast physical distribution media having 50 
relatively fast data transfer rates that do not significantly 
limit the speed at which an image can be prepared and 
displayed for viewing, such as CD-ROMs, floppy disks, or 
hard disks accessed through local bus or network interfaces. 

Preferred production methods include preparing a single 55 
compressed data representation of each digitally-represented 
still image in a multi-resolution compression format The 
preferred methodological steps further include storing a still 
image on both slow distribution media and fast distribution 
media using the same single compressed data representation, 60 
thereby eliminating the need for preparing more than one 
data representation for each different type of distribution 
media. The invention further includes a step of distributing 
the single compressed data representations via both the slow 
distribution media and the fast distribution media. As a result 65 
of these methods, production costs of software products 
containing still images can be greatly reduced. Furthermore. 
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are still being decompressed by the decompression compo- 
nent. 

4. A still image display system comprising: 

a non-volatile data storage medium; 

a selected still image stored as a compressed data file on 
the non-volatile data storage medium; 

a progressive decompression component which decom- 
presses the compressed data file and produces succes- 
sive versions of the selected still image at progressively 
increasing resolutions; 

a data retrieval medium operably connected to supply the 
compressed data file from the non-volatile data storage 
medium to the decompression component at a rate 
which is at least as fast as the decompression compo- 
nent can decompress the compressed data file; 

a visual display device; 

an image display component operably connected to suc- 
cessively display the successive versions of the selected 
still image produced by the decompression component 
on the visual display device; 

wherein the decompression component acts concurrently 
with the data retrieval medium to decompress the 
compressed data file concurrently with retrieving the 
compressed data file from the non-volatile data storage 
medium. 
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5. A still image display system as recited in claim 4 execution threads to display versions of the selected still 
wherein the compressed data file is stored on the non- image while decompressing subsequent versions of the 
volatile data storage medium in a multi-resolution compres- selected still image from the compressed data file. 

sion format using a discrete wavelet transform 15. A computer as recited in claim 11 wherein the data 

6. A still image display system as recited in claim 4 5 processor is programmed to decompress the data rile only 
wherein the compressed data file is stored on the non- after retrieving the entire data file from the local non-volatile 
volatile data storage medium in a multi-resolution compres- ^ storage medium and to execute at least two concurrent 
sion format which allows efficient progressive decompres- execution threads to display versions of the selected still 
sion and display of the selected still image. ^ whik ^^^^ subsequent versions of the 

7. A still image display system as recited in claim 4 !0 sclected stm . fromthc convressed ^ mCt 
wherein the decompression component acts subsequent to A ^ a$ lM m claim u wheR;in Ac Jocal 
me data retrieval medium to decompress me compressed noD . volatflc Xta storage medium is a CD-ROM. 

data file after retrieving the compressed data file from the , " aiuiog* iuw*i , . . 1 , 

™ „^u#:u a*** ^m^Z 17. A computer as recited in claim 11 wherein the local 
non-volatile data storage medium. 

8. A stiU image display system as recited in claim 4 15 non-volatile data storage medium is a hard disk, 
wherein the image display component acts concurrently with 18 * A method of storin 8 ™* paying a still image 
the decompression component to display versions of the comprising the following steps: 

sclected still image while subsequent versions of the storing a selected still image on a non-volatile data 

selected still image are still being decompressed by the storage medium as a compressed data file; 

decompression component. 20 retrieving the compressed data file from the non-volatile 

9. A still image display system as recited in claim 4 stor age medium at a data transfer rate; 

cSROM thC DOn ' V ° latile St0fagC 15 " deeming to 

10. A still image display system as recited in claim 4 ccss * vc vcrsions of ^ sclcctcd stU | ^ at P ro ^ es " 
wherein the non-volatile data storage medium is a hard disk. 25 siy ^ ^creasing resolutions at a decompression rate 

U. A computer comprising: which is 45 &™ x " mc * msfcr rate; 

a local non- volatile data storage medium; successively displaying the versions of the selected still 

a visual display device; 011 a visual deyicc; 

a selected still image stored as a compressed data file in „ wh *™ retrieving and decompressing steps are per- 

a multi-resolution compression format on the local formed concurrentiy. 

non-volatile data storage medium, said multi-resolution * 9 - A method as recited in claim 18 wherein the storing 

format being of a type which allows efficient progres- step comprises storing the still image in a multi-resolution 

sive decompression and display of the selected still compression format which allows efficient progressive 

image; 3J decompression and display of the selected still image. 

a data processor programmed to decompress the com- 20- A method as recited in claim 18 wherein the staring 

pressed data file; to produce successive versions of the step comprises storing the still image in a multi-resolution 

selected still image at progressively increasing resolu- compression format which allows efficient progressive 

tions; and to display the successive versions on the decompression and display of the selected still image, and 

visual display device; 40 wherein the retrieving and decompressing steps are per- 

a data retrieval medium through which the data processor formed concurrently, 

retrieves the compressed data file from the local non- »• A method as recited in claim 18 and further compris- 

volatiledata storage medium, the data retrieval medium in 8 compressing the selected still image using a discrete 

having a data transfer rate that is at least as fast as the wavelet transform. 

data processor can decompress the compressed data file 45 A method as recited in claim 18 wherein the decom- 

and display the successive versions of the selected still pressing step is performed only after the retrieving step is 

image; completed. 

wherein the data processor is programmed to execute at . »• * mcthod 35 ta Cl ^Jl^ n ^±^ y - 

least two concurrent execution threads for retrieving <^mpressing s^ps are formed concurrently, 

the compressed data file from the non-volatile dato *> mcthod as rcated m daun 18 whcrcin: 

storage medium and for decompressing the compressed the decompressing step is performed only after the 

data file, respectively. retrieving step is completed; and 

12. A computer as recited in claim 11 wherein the com- the displaying and decompressing steps are performed 
pressed data file is compressed in a multi-resolution com- concurrently, 

pression format using a discrete wavelet transform. 35 25. A method as recited in claim 18 wherein the storing 

13. A computer as recited in claim 11 wherein the data step comprises storing the selected still image on a 
processor is programmed to decompress the data file only CD-ROM. 

after retrieving the entire data file from the local non-volatile 26. A method as recited in claim 18 wherein the storing 

data storage medium. step comprises storing the selected still image on a hard disk. 

14. A computer as recited in claim 11 wherein the data 60 

processor is programmed to execute at least two concurrent ***** 
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